Web Survey Bibliography
Inattentiveness and social desirability might be particularly problematic for self-report scales in creativity and arts research. Respondents who are inattentive or who present themselves favorably will score highly on scales that yield positively skewed distributions and that assess socially valued constructs, such as scales measuring creativity and arts knowledge. A total of 204 undergraduates completed an online survey with several self-report measures (the Creative Achievement Questionnaire, the Biographical Inventory of Creative Behavior, and the Aesthetic Fluency Scale). Many metrics of inattentiveness were included, such as directed response items, self-reported attentiveness, and scales to catch inconsistent and patterned responses. The Balanced Inventory of Desirable Responding measured facets of social desirability. We found high rates of inattentive responding. A latent class analysis indicated that around 25% of the sample was potentially inattentive, and inattentive respondents received higher scores on the creativity and arts scales. Excluding problematic participants increased the effect sizes of interest, consistent with the coarsening effect of careless participants. Social desirability, in contrast, had essentially no relationship with the creativity and arts scales. These findings suggest that social desirability is probably less of a problem than researchers fear, but that inattentiveness is an underappreciated threat. Some practical guidelines are suggested.
Web survey bibliography (4086)
- Hidden Populations, Online Purposive Sampling, and External Validity: Taking off the Blindfold; 2015; Barrat, M. J.; Ferris, J. A.; Lenton, S.
- Improving Response to Household Surveys Using Mail Contact to Request Responses over the Internet: Results...; 2015; Dillman, D. A.
- The quality of data collected using online panels: a decade of research ; 2015; Callegaro, M.
- Sub-optimal Respondent Behavior and Data Quality in Online Surveys; 2015; Thomas, R. K.
- The role of gamification in better accessing reality and hence increasing data validity ; 2015; Bailey, P.; Kernohan, H.; Pritchard, G.
- Rewarding the Truth; 2015; Puleston, J.
- An experiment testing six formats of 101-point rating scales; 2015; Liu, M.; Conrad, F. G.
- Emerging Technologies: The Rise of Mobile Devices: From Smartphones to Smart Surveys; 2015; Buskirk, T. D.
- A Free Audio-CASI Module for LimeSurvey; 2015; Beier, H.; Schulz, S.
- Self-identification of occupation in web surveys: requirements for search trees and look-up tables ; 2015; Tijdens, K. G.
- Mode System Effects in an Online Panel Study: Comparing a Probability-based Online Panel with two Face...; 2015; Struminskaya, B.; De Leeuw, E. D.; Kaczmirek, L.
- Using Incentives and Multiple Modes of Data Collection to Improve Response Rate: Results from the National...; 2015; Howden, L. M.; Joestl, S. S.; Cohen, R. A.
- Utilizing iPads in the Field; 2015; Kiser, P.
- Mixed Mode Design Considerations; 2015; Hupp, A.
- Enhancing Response Usability in a Web-based Survey, But Did Anyone Use It?; 2015; Yoder, R.
- Mixed Mode Design Considerations: Panel Discussion; 2015; Smyth, J.; Hupp, A.; Elver, K.
- PayPal? An Incentive to Check-out?; 2015; Franklin, J.; Rasmussen, C.; Pruitt, J.; Waller, D.
- Standard Definitions: Final Dispositions of Case Codes and Outcome Rates for Surveys 2015; 2015
- Mixed mode surveys ; 2015; Burton, J.
- The Web Survey Revolution ; 2015; Murray, D.
- The Evolution of CAPI; 2015; Johnson, A. J.
- Online Questionnaire for Survey Research: Comparative Study of the Features Available with Free Account...; 2015; Subhash, K.
- Methodology of the RAND Mid-Term 2014 Election Panel; 2015; Carman, K. G; Pollack, S.
- An Experiment in Open End Response Length in Relation to Text Box Length in a Web Survey; 2015; Traugott, M. W.; Antoun, C.
- Item nonresponse in open-ended questions: Identification and reduction in web surveys; 2015; Kaczmirek, L.; Behr, D.
- Metrics and Design Tool for Building and Evaluating Probability-Based Online Panels; 2015; DiSogra, C.; Callegaro, M.
- 28 Questions to Help Buyers of Online Samples; 2015; Cape, P. J.; Phillips, A.; Baker, R.; Cooke, M.; Ribeiro, E.; Terhanian, G.
- Designing Bonsai Surveys: The small but perfectly formed survey experience to meet the needs of the...; 2015; Puleston, J.
- Ethical decision-making and Internet research 2.0: Recommendations from the AoIR ethics working committee...; 2015; Markham, A.; Buchanan, E. A.
- Impact of raising awareness of respondents on the measurement quality in a web survey; 2015; Revilla, M.
- Analysis of four recruitment methods for obtaining normative data through a Web-based questionnaire:...; 2015; Nolte, M. T.; Shauver, M. J.; Chung, K. C.
- Open narrative questions in PC and smartphones: is the device playing a role?; 2015; Revilla, M.; Ochoa, C.
- Gamification of Online Surveys: Design Process, Case Study, and Evaluation; 2015; Harms, J.; Biegler, S.; Wimmer, C.; Kappel, K.; Grechenig, T.
- Equivalency of Paper Versus Tablet Computer Survey Data; 2015; Ravert, R. D.; Gomez-Scott, J.; Donnellan, M. B.
- Higher response rates at the expense of validity? Consequences of the implementation of the ‘forced...; 2015; Decieux, J. P.; Mergener, A.; Neufang, K.; Sischka, P.
- Development and Validation of a Scale for Social Exhibitionism on the Internet (SEXI); 2015; Vetter, M.; Eib, C.; Hill-Kloss, S.; Wollscheid, P.; Hagemann, D.
- Comparison of self-administered survey questionnaire responses collected using mobile apps versus other...; 2015; Belisario, J. S. M.; Jamsek, J.; Huckvale, K.; O'Donoghue, J.; Morrison, C. P.; Car, J.
- Evaluating the Distorting Effects of Inattentive Responding and Social Desirability on Self-Report Scales...; 2015; McKibben, W. B.; Silvia, P. J.
- A quasi-experiment on effects of prepaid versus promised incentives on participation in a probability...; 2015; Schaurer, I.; Bosnjak, M.
- Surveys: Question Wording and Response Categories; 2015; Schaeffer, N. C.; Dykema, J.
- Doing online research involving university students with disabilities: Methodological issues; 2015; De Cesarei, A.; Baldaro, B.
- Understanding Society Innovation Panel Wave 7: Results from Methodological Experiments; 2015; Blom, A. G.; Burton, J.; Booker, C. L.; Cernat, A.; Fairbrother, M.; Jaeckle, A.; Kaminska, O.; Keusch...
- Response Effects of Prenotification, Prepaid Cash, Prepaid Vouchers, and Postpaid Vouchers: An Experimental...; 2015; van Veen, F.; Goeritz, A.; Sattler, S.
- Correcting for non-response bias in contingent valuation surveys concerning environmental non-market...; 2015; Bonnichsen, O.; Boye Olsen, S.
- Can we augment web responses with telephonic responses to a graduate destination survey?; 2015; du Toit, J.
- Email subject lines and response rates to invitations to participate in a web survey and a face-to-face...; 2015; Sappleton, N.; Lourenco, F.
- Comparison of Internet and interview survey modes when estimating willingness to pay using choice experiments...; 2015; Mjelde, J. W.; Kim, T. K.; Lee, C.-K.
- Exploring ethical issues associated with using online surveys in educational research; 2015; Roberts, L. D.; Allen, P. J.
- Data collection mode effect on feeling thermometer questions: A comparison of face-to-face and Web surveys...; 2015; Liu, M., Wang, Yi.
- Do Attempts to Improve Respondent Attention Increase Social Desirability Bias?; 2015; Clifford, S.; Jerit, J.